View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0001222 | T99X171.00 SKB Eagle | SW | public | 2021-05-10 11:53 | 2021-06-23 15:08 |
| Reporter | (ALTech) Younkwang Jung | Assigned To | (ALTech) Younkwang Jung | Due Date | |
| Priority | high | Severity | s2-severe | Reproducibility | always |
| Status | closed | Resolution | fixed | ||
| Summary | 0001222: [Smart3][BTF] Google Certification 2021/May | ||||
| Description | Hi Jason Ling There is a request from SKB to let us know the Google certification schedule. We are going to proceed with Google certification with FW, which will be built this afternoon. Please let me know the fastest schedule for Google authentication. As far as I know, the game pad issue has been discussed with SKB and Jeff Koo. so waiver is possible. Please double-check it as well. Thanks YK.Jung | ||||
| Tags | No tags attached. | ||||
| Attach Tags | |||||
| User List |
(ALTech) SY Yoon , (ALTech) Wooshin Kang , |
|---|
|
|
Hi Jason Ling The FW for Google Certification will use the v15.524.4b file. ( 0505_524r04b_at100 ) And please let me know the fastest schedule for Google authentication. Thanks YK.Jung |
|
|
Hi YK, Did you mean that SKB want to use older FW for certification? Could you check the fingerprint of the target FW is correct? getprpop | grep finger SKB/BFX_AT100/BFX-AT100:10/QTT5.200429.010/15.524.4-20210505:user/release-keys |
|
|
Hi YK, Could you check the version that SKB want to submit to 3PL? Because we have released v15.524.4c this morning. By the way, our QA are working on other project, they are not in office today, I have requested QA resource with QA leader, they will start pre-test from tomorrow morning. if SKB want to submit 15.524.4b, our QA has done partial test with this version (15.524.4b) last week. so I think that they can finish the pre-test before this Wed night. we will try to book 3PL on this Thu. I will update the status of pre test every morning. |
|
|
Hi Jason This is the BMT fw image information. ( v15.524.4b ) / Security patch 2021/APR/05 BFX-AT100:/ $ getprop | grep finger [ro.bootimage.build.fingerprint]: [SKB/BFX_AT100/BFX-AT100:10/QTT5.200429.010/15.524.4-20210505:user/release-keys] [ro.build.fingerprint]: [SKB/BFX_AT100/BFX-AT100:10/QTT5.200429.010/15.524.4-20210505:user/release-keys] [ro.build.version.preview_sdk_fingerprint]: [REL] [ro.odm.build.fingerprint]: [SKB/BFX_AT100/BFX-AT100:10/QTT5.200429.010/15.524.4-20210505:user/release-keys] [ro.product.build.fingerprint]: [SKB/BFX_AT100/BFX-AT100:10/QTT5.200429.010/15.524.4-20210505:user/release-keys] [ro.system.build.fingerprint]: [SKB/BFX_AT100/BFX-AT100:10/QTT5.200429.010/15.524.4-20210505:user/release-keys] [ro.vendor.build.fingerprint]: [SKB/BFX_AT100/BFX-AT100:10/QTT5.200429.010/15.524.4-20210505:user/release-keys] Please proceed with the Google test as soon as possible with this FW. Thanks YK.Jung |
|
|
Hi Jason Thank you for doing the Google test in advance. I will let you know if there is any update. Thanks YK.Jung |
|
|
Hi Jason Skb wants to know the full schedule for Google certification and when can we get Google approval Roughly ? FXN internal Test : 5/5 ~ 5/12 3PL Test : 5/13 ~ ? Google review : ? ~ ? if FXN submit it to 3PL on the 13th , please let me know approximately the duration of the 3PL Test and Google review Thanks YK.Jung |
|
|
Hi YK, FXN internal Test : 5/5 ~ 5/12 3PL Test : 5/13 ~ 5/24 (According to 3PL's announcement, they need 8 working days, but we must check if they can start review from 5/13 first.) Google review : 5/25 ~ ? (I can't evaluate this item. Base on previous case, Google can finish the reviewing within 2 days, but it's the best case, In the Google announcement, Google said they need 1 week to review, If Google don’t finish it within 1 week, we can ask 3PL to check with Google again) |
|
|
Hi YK, Update Status (15.524.4b) - 2021/05/11 moring CTS: ongoing GTS: finished CTS-Verifier: not started (will be started today) VTS: finished CTS-ON-GSI: finished STS: finished TVTS: finished SmokeTest: not started (will be started today) |
|
|
Hi Jason Thank you for the information. I sent this information you told me to SKB. I will let you know if there is any update later. And please let me know if 3PL can start the review on 5/13. Thank you. YK.Jung |
|
|
Hi YK, Update Status (15.524.4b) - 2021/05/12 morning CTS: finished GTS: finished CTS-Verifier: finished VTS: finished CTS-ON-GSI: finished STS: finished TVTS: finished SmokeTest: ongoing We have send the booking mail to 3PL, but we haven't gotten a response yet. we will check it with 3PL directly today. Could you let us know the status of BMT? |
|
|
Hi Jason Thank you for updating the status. I discussed this with SKB manager yesterday. SKB manager tells us to get Google certification with this FW regardless of BMT status. Additional , BMT will be finished early next week. ( there is no issue so far ) Please update it one more time when the Google Test is completed. Thank you YK.Jung |
|
|
HI YK, I think we can finished the pretest this evening. After checking with 3PL, they can start the review from Thu. |
|
|
Hi YK, Update Status (15.524.4b) - 2021/05/13 morning CTS: finished GTS: finished CTS-Verifier: finished VTS: finished CTS-ON-GSI: finished STS: finished TVTS: finished SmokeTest: finished Already submitted to 3PL. |
|
|
Hi Jason Could you update the current progress in 3PL and whether it will be finished on the 24th as expected? Thank you YK.Jung |
|
|
Hi YK, 1. Finished: STS/TVTS/VTS/CTS 2. Ongoing: SmokeTest Lite/CTS-Verifeir 3. Almost Finished: GTS/CTS-ON-GSI, (3PL encounter 2 failures and need to clarify) 3-1. run cts-on-gsi -m CtsStatsdHostTestCases -t android.cts.statsd.atom.UidAtomTests#testLmkKillOccurred the result of our pretest report is PASS, After 3PL reporting this issue, our QA did the single test, the result was always fail, I tested it more than 10 times, only 2 times pass. Now we don't know the method to pass it stably. I am checking with Amlogic FAE, You can also check it with other OEM. 3-2. run gts -m GtsGmscoreHostTestCases -t com.google.android.gts.audio.AudioHostTest#testFocusChangeMediaToGuidance We know the test method to pass it (Before testing it, it need to clear BTV data and force stop BTV in TvSettings, 3PL said that they already followed our method, but the result is still fail, I am checking it) Due to a local COVID-19 outbreak in Taiwan this week, Some of 3PL engineers do not work in their office. This may impact the expected date. I check the status with 3PL everyday. If there is any information, I will let you know. |
|
|
Hi Jason About 3-1. run cts-on-gsi -m CtsStatsdHostTestCases -t android.cts.statsd.atom.UidAtomTests#testLmkKillOccurred I asked INTEK about this test item. INTEK also fails at first when testing this item, but it passes immediately after that. If it is not passed immediately, INTEK manager tell me to try after IPv6 connection or factory reset. I don't think I can get any more information from the INTEK. Is there anything else I can help you ? Thank you YK.Jung |
|
|
Hi YK, Thanks for your help, But I don't think IPv6 and factory reset can help us pass this item, because both our QA and 3PL have IPv6 environment. I have checked the difference between the pass log and fail log, I found very weird system property [ro.lmk.log_stats] According to the source code of test program (https://android.googlesource.com/platform/cts/+/refs/tags/android-vts-10.0_r7/hostsidetests/statsd/src/android/cts/statsd/atom/UidAtomTests.java) line #87, if the value of the property ro.lmk.log_stats is not equal true, the test result will be PASS. You can check the attachment, I don't know why this property is sometimes null, sometime true. When the value of property is true, it will make test result fail. The property is from system/etc/prop.default, the location of prop.default is in system partition (from flashing Google System image), and it's ready only property, Currently, I don't know why the value of property is random. I still working with Amlogic to check it. |
|
|
Hi YK, Could you check the GSI version used by INTEK? Command: getprop ro.build.version.incremental OR getprpop ro.system.build.version.incremental Thanks |
|
|
HI Jason I'm checking again because it's weird. I test command "getprop ro.build.version.incremental" at My Smart3 STB. This command only displays the FW version name and date. Is it right that you want this information at INTEK STB ? Thanks YK.Jung |
|
|
Hi YK, The test suite is CTS-ON-GSI, so before checking this property, we need to flash Google System image first. Because you didn't flash Google System image, so the version you see is defined by us. I want to check the version of Google System.img INTEK used. Thanks |
|
|
HI Jason INTEK's GSI version is 7311779 Thanks YK.Jung |
|
|
Hi YK, I have already tested the version 7311779 this afternoon. The result is fail, and I still couldn't find a stable way to pass it. I also asked our QA to test it again with daily build CTS-ON-GSI tool. If there is no issue with daily build tool. we will ask 3PL to use daily build to verify it again. |
|
|
Hi YK, Regrading the CTS-on-GSI test failure,, Amlogic FAE gave me one patch this morning. The patch can make the test item pass stably. But It's too late, because we are going to 3PL process with 15.524.4b, we can not change FW. Currently Amlogic don't have test method to pass it stably. And this item is removed from daily build test suite, so our QA re-ran the CTS-ON-GSI with daily build test suite. There is no new issue. so I ask 3PL to test it again with CTS-ON-GSI daily build test suite this afternoon. |
|
|
Hi Jason Please update the 3PL progress. And please let me know the estimated schedule when 3PL can be finished. And I will update you about the current situation of SKB. It ended without any issue in BMT (v15.524.4b). The v15.524.4b version has been distributed to user about 60k and is currently monitoring the issue. Several VoC issues have been reported and are being analyzed. ( no signal / video error / ota / etc.. ) Thank you YK.Jung |
|
|
Hi YK, Still ongoing: CTS-Verifier/SmokeTest/CTS-ON-GSI (daily build) And 3PL still can not pass GTS failure even they use our test method. I am asking them to provide us some logs for analysis. |
|
|
Hi YK, 3PL finally passed the GTS failure this morning. Now, still ongoing is as follow, CTS-Verifier/SmokeTest/CTS-ON-GSI (daily build) |
|
|
Hi YK, 3PL already submitted all results to Google this afternoon. Regarding CTS-ON-GSI failure, (run cts-on-gsi -m CtsStatsdHostTestCases -t android.cts.statsd.atom.UidAtomTests#testLmkKillOccurred) Because we don't know the stable test method to pass it. Our QA and 3PL have retried more than 20 times, the result is still fail. (The result in our pre test was Pass) so I asked 3PL to test CTS-ON-GSI again with daily build tool. (Daily build tool has excluded CtsStatsdHostTestCases test item) https://android.googlesource.com/platform/test/vts/+/691f41968e2cd220249e55b5ca25e428b39972b5%5E%21/#F0 Finally, 3PL uploaded the official tool result and daily build tool result to Google site. If Google TAM see the CTS-ON-GSI failure, we may need to explain it. Regarding the patch of CTS-ON-GSI failure, Amlogic released the patch to make it stable on 05/21. I already committed it to Bitbucket today. |
|
|
Hi Jason Is there any update from TAM? Thank you YK.Jung |
|
|
Hi YK, Regrading the 15.524.4, I saw that Google TAM mark status as "REVIEW" on google site this morning. I think he is reviewing. |
|
|
Hi Jason Is there any update from TAM? It seems to be delayed more than expected. Please check it again. Thank you YK.Jung |
|
|
Hi YK, I had checked it with 3PL this morning. They haven't got any feedback. |
|
|
Hi YK, Google has approved 15.524.4. |
| Date Modified | Username | Field | Change |
|---|---|---|---|
| 2021-05-10 11:53 | (ALTech) Younkwang Jung | New Issue | |
| 2021-05-10 11:53 | (ALTech) Younkwang Jung | Status | new => assigned |
| 2021-05-10 11:53 | (ALTech) Younkwang Jung | Assigned To | => (SW) Jason Ling |
| 2021-05-10 11:53 | (ALTech) Younkwang Jung | Issue Monitored: (ALTech) SY Yoon | |
| 2021-05-10 11:54 | (ALTech) Younkwang Jung | Issue Monitored: (ALTech) Wooshin Kang | |
| 2021-05-10 11:54 | (ALTech) Younkwang Jung | Issue Monitored: (SW) Kerwin Chen | |
| 2021-05-10 11:54 | (ALTech) Younkwang Jung | Issue Monitored: (SW) Jacky Chiang | |
| 2021-05-10 11:54 | (ALTech) Younkwang Jung | Description Updated | View Revisions |
| 2021-05-10 13:48 | (ALTech) Younkwang Jung | Note Added: 0007059 | |
| 2021-05-10 14:24 |
|
Note Added: 0007061 | |
| 2021-05-10 16:11 |
|
Note Added: 0007064 | |
| 2021-05-10 16:43 | (ALTech) Younkwang Jung | Note Added: 0007065 | |
| 2021-05-10 16:49 | (ALTech) Younkwang Jung | Note Edited: 0007065 | View Revisions |
| 2021-05-10 16:54 | (ALTech) Younkwang Jung | Note Added: 0007066 | |
| 2021-05-10 16:54 | (ALTech) Younkwang Jung | Note Edited: 0007066 | View Revisions |
| 2021-05-10 16:55 | (ALTech) Younkwang Jung | Note Edited: 0007066 | View Revisions |
| 2021-05-11 08:03 | (ALTech) Younkwang Jung | Note Added: 0007070 | |
| 2021-05-11 08:53 |
|
Note Added: 0007072 | |
| 2021-05-11 08:57 |
|
Note Added: 0007073 | |
| 2021-05-11 08:58 |
|
Note Edited: 0007072 | |
| 2021-05-11 09:54 | (ALTech) Younkwang Jung | Note Added: 0007074 | |
| 2021-05-12 08:47 |
|
Note Added: 0007088 | |
| 2021-05-12 09:40 | (ALTech) Younkwang Jung | Note Added: 0007091 | |
| 2021-05-12 09:54 |
|
Note Added: 0007092 | |
| 2021-05-13 08:34 |
|
Note Added: 0007101 | |
| 2021-05-20 11:36 | (ALTech) Younkwang Jung | Issue Monitored: (SW) Brent Choi | |
| 2021-05-20 11:39 | (ALTech) Younkwang Jung | Note Added: 0007179 | |
| 2021-05-20 12:15 |
|
Note Added: 0007180 | |
| 2021-05-20 15:35 | (ALTech) Younkwang Jung | Note Added: 0007181 | |
| 2021-05-20 16:30 |
|
File Added: 1621496118183.jpg | |
| 2021-05-20 16:30 |
|
Note Added: 0007182 | |
| 2021-05-20 16:52 |
|
Note Added: 0007183 | |
| 2021-05-20 17:26 | (ALTech) Younkwang Jung | Note Added: 0007184 | |
| 2021-05-20 17:33 |
|
Note Added: 0007185 | |
| 2021-05-20 17:33 |
|
Note Edited: 0007185 | |
| 2021-05-20 19:39 | (ALTech) Younkwang Jung | Note Added: 0007187 | |
| 2021-05-20 20:11 |
|
Note Added: 0007188 | |
| 2021-05-21 16:18 |
|
Note Added: 0007202 | |
| 2021-05-24 10:25 | (ALTech) Younkwang Jung | Note Added: 0007209 | |
| 2021-05-24 11:10 |
|
Note Added: 0007211 | |
| 2021-05-25 11:07 |
|
Note Added: 0007219 | |
| 2021-05-25 19:47 |
|
Note Added: 0007227 | |
| 2021-05-31 09:03 | (ALTech) Younkwang Jung | Note Added: 0007296 | |
| 2021-05-31 10:41 |
|
Note Added: 0007300 | |
| 2021-06-04 08:54 | (ALTech) Younkwang Jung | Note Added: 0007357 | |
| 2021-06-04 09:43 |
|
Note Added: 0007360 | |
| 2021-06-09 21:40 |
|
Assigned To | (SW) Jason Ling => (ALTech) Younkwang Jung |
| 2021-06-09 21:40 |
|
Status | assigned => resolved |
| 2021-06-09 21:40 |
|
Resolution | open => fixed |
| 2021-06-09 21:40 |
|
Note Added: 0007422 | |
| 2021-06-23 15:08 | (ALTech) Younkwang Jung | Status | resolved => closed |
